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ABSTRACT 

Digraphs, graphs, and task analysis vere used to map 
out the content structure of a programed text (SMSG) in elementary 
probability. Mathematical structure war defined as the relationship 
between concepts within a set of abstract systems. The word 
association technique was used to measure the existing relations 
(cognitive structure) in S's memory with respect to the probability 
theory present in the text. The purpose of this study was to measure 
the Influence of content structure (mathematical structure) of the 
text on the Ss» cognitive structure. Control and experimental Ss 
(N« 3*1) were high school (grades 9-12) subjects recruited from study 
halls and mathematics classes in one high school. Experimental Ss 
(N«20) studied the probability text while the others studied a 
programed text on an unrelated mathematical topic. i'Dr subjects in 
the experimental group, a strong similarity between the 
representation of content structure and cognitive structure was 
found. The structure methodology used in this study appears to be 
applicable to many aspects of research on learning mathematical 
structures and might be a helpful tool in formative evaluation of 
mathematics curricula. The data on content structure and cognitive 
structure seem to suggest ways to improve the text to further student 
learning of structure. (JP) 
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During the past decade mathematics curricula have been revised signi- 
ficantly. Curriculum developers have attempted to communicate something more 
than algorithms and conputational skills to the student (cf. Report of the 
Conmission on mathematics j 1959); they have atternpted to conmunicate structui-^es 
in mathematics (Report of the Cambridge Conference> 1963)* Branca (197^) 
reviews the history of this change in emphasis. spite of the recent emphasis 
on structure in mathematics curricula, little empirical work has been done 
concerning the conmunlcatlon of a mathematical structure to students. This 
study examined the correspondance between representations of the structure of 
a prograrmBd probability uiit (content structure) and a representation of 
this structure in high school students' memories (cognitive stinictures) as a 
result of studying the probability luilt. 

In a manner consistent with Shavelson's (1971jl974) definition oi structure, 
Pegle (in preparation) defined mathematical structure as '^a set of Intei^late d^ 
abstract, s ymbolic systems .'^ He stressed the point that mathematical structure 
is a conbination of v/ithin system relationships and betv;een system relationships. 
For the piuposes of this study, irathematical stt^cture is defined as the 
relationships between concepts within a set of abstract systems . 

In this study students received insti^uction in probability (the to-be- 
learned structure) or in an unrelated topic in mathematics. Before and after 
Instruction, the word association test, a measure of cognitive structure. 
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*A paper presented at the annual meeting of the American Educational 
Research Association, Chicago, April, 197^ • 



vias given, The representation of cognitive structure frc^ the word ass6clat Ion 
test was comparea with the representation of content structure obtained 
vdth the digraph and graph methods, Tiye correspondence between these 
two representations was interpreted as the correspondence between content 
structure and cognitive structure. Even though these representations of 
structure are not comprehensive or error free, they represent an iirportant 
'ilrst step in answering crucial questions about this correspondence* 

rfethod 

Subjects 

The 3^ subjects were middle and upper-middle soclo-econoudc status, 
Caucasian volunteers recruited fron study halls and mathematics classes 
in one high school (grades 9-12). 
Instructional Material 

The instructional material was an Introductory prograrrmed text on . 
probability* One purpose of this text was to cormiunlcate a subject-^natter 
structure, that of elementary probability, to the subjects. Probability was 
selected because the topic was unfamiliar to most high school students, was 
easily placed in the nonral curriculum sequence, and required few mathematical 
prerequisites. The progra/mied text format—smsill steps, constructed responses, 
and continual feedback on the correct responses — was used to minimize the 
chance that proctors would ^'teach" a structure different fTon that presented 
by the text by answering subjects' questions. It also allowed each student 
to proceed at his own pace. The text, divided into three sections of approxi- 
mately seventy pages each, covered the following key concepts in probability: 
PROBABILITY, EXPERIMENT, OUTCOME, EQUALLY LIKELY, EVEtlT, TRIAL, INTERSECTION, 
ZERO, INDEPENDENT, and MUTALLY EXCLUSIVE. The key concepts were used in 
the analysis of content structure and as stimuli on a word association (WA) 



^ The text, developed by the School Mathematics Study Group, Is available 
from the ERIC Document Reproduction Service, Arlington, Virginia. 



test — a measiu^ of cognitive structure . 



Representation of Content Structure 



Follovdng the digraph procedure described by Shavelson (1974), a 



10 X 10 digraph distance matrix representing the shortest distances 
between pairs of the ten key concepts was derived and then converted into 
a 10 X 10 similarity matrix (cf. Geeslln, 1973). 'The elements in the 
similarity matrix indicated the "closeness" of each pair of concepts. Nbte 
that this procedui'e may result in an asymetric matrix. Ihe similarity 
matrix was examined using Kruskal's (196^1) multidljnensional scaling procedure. 
A plot of the results is shown in Figure 1. Figure 1, then, is interpreted 
as a representation of the structure of the probability text. 



Figure 1 
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The multidimensional scaling results of the digraph analysis of content 
structure are shown In Figiu:^ 1, The results are consistent vdth our inter- 
pretation of the subject-matter* Although interpretation of the multi- 
dljnensional scaling solution is somewhat subjective, dimension 1 seems 
to reflect the notion of using mathematics as a model of ^'real-world" experience* 
lhat is, EXPERIMENT, OUTCOME, TRIAL, and EQUALLY LIKELY are (concrete) concepts 
that can be observed in the physical world; the other concepts (moving from 
right to left) are (abstract) mathematical concepts that we use to build a 
mathematical model of the physical world. 

As for the second dimension, three clusters of key concepts may be 
Identified. Cluster 1 Includes the concepts of MUTALLY EXCLUSIVE (M), 
INDEPENDENT (I), and EVENT (E) . Cluster 2 contains the concepts of TRIAL (T), 
OUTCOME (0), EQUALLY LIKELY (L), and EXPERIMENT (X). Cluster 3 groups togethe^^ 
the concepts of PROBABILITY (P), INTERSECTION (S), and ZERO (Z), Ihese 
clusters may form a hierarchy of mathematical concepts with clusters 1 and 2 
at one level and cluster 3 at the next superordlnate level. Cluster 1 (M,I,E,) 
represents mathematical concepts modeling cluster 2 (T,0,L,X), the physical 
concepts, and concepts in cluster 3 (P,S,Z) are mathematical concepts that 
tie together the model and the physical world. 

A second method for representing content structure is graph theory 
(Harary and Norman, 1953)* Graph theory may be distinguished from digraph 
theory in that the former Ignores the direction of lines while the latter 
places an emphasis on directed lines. The sane key concepts were used In . 
this analysis as were used in the digraph analysis. The only change made 
in Shavelson^s digraph procedures was to replace directed lines vdth non- 
directed lines. Thus the elements in the graph distance matrix are equal 
to the smallest element In each pair of corresponding cells in tte digraph 
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distance matrix. Note that' the graph distance matrix will always be synmetric 
while this is not necessarily true of the digraph distance mtrix. Obviously 
if a syntnetrlc dlgi^aph results from the digraph analysis, the structure 
representations by graph and digraph will be equivalent. The graph distance 
matrix was converted into a 10 x 10 similarity mtrix and examined using 
multidimensional scaling. The plot of the results, shown in Figure 2, is 
Interpreted as a second representation of the structure presented by the 
probability text. . 

Figure 2 
IWo Dimensional Scaling Solution 
For the Graph Analysis of Content Structure 
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Examining Figure 2, the graph representation of content structure, 
we see no essential differences from the digraph representation. TRIAL 
(T) and OUTCOME (0) are not. distinguishable in the graph analysis in- 
dicating that we lose some Infonnation in this analysis as expected. 
Since no major differences were observed between the digraph and graph 
analysis of content structure, we will refer only to the digraph rep- 
resentation in the remainder of this discussion* 

Finally, task analysis was used to map the structure of the Instruc- ' 
tional material (Gagne, 1965, 1970). Task aiialysis produces an alternate 
(to the digraph/graph analyses) structural representation. Points repre- 
sent conpetencies and lines represent relationships between conpetencies. 
This is a psychological definition of structure and therefore different 
from what subject-matter experts mean when they use the term structure. 
However, we use task analysis in the present study to link the digraph/ 
graph representations to a more traditional approach. 

The resultant hierarchy is presented in Figure 3t The investigator was 
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not able to determine a satisfactory method for obtaining a "distance'^ 
matrix from the resultant heirarchy. One could count '^boxes" between 
concepts, but the boxes do not represent concepts alone but rather they 
represent inanipulatlons or performances vdth concepts . Thus , for example , the 
concepts OUTCOME and EVEOT appear in several boxes and one could arrive 
at several distances between these concepts depending on the boxes selected. 
Additionally, the boxes are derived in a somewhat subj A 
logical analysis by one author may not be the same as a logical analysis 
for a second author; thus causing the two authors to arrive at different 
distance matrices. The task analysis should be useful in interpreting 
the other content analyses and the analyses of the WA data, but does not 
appear to be a satisfactory representation of structure as we have defined it, 
Representation of Coeiitive Structure 

Cognitive structure was investigated using a word association technique 
(Geeslln, 1973i Johnsoti, 196? i 1969; Shavelson, 1971 , 1972 , 1973) . 
Ehpirlcal evidence in support of the cognitive stnjictu^ of 
WA data has been provided by Shavelson (197^) and can be found in a number 
of other sources (Deese 1962; Johnson 1967; and Shavelson 1971, 1972,1973). 

The WA test consisted of one page of Instructions Hiid one page for 
each set of responses to each of the ten key concepts, respectively. 
Subjects were instructed to write as many other mathematical concepts 
related to the key concept as they could In one minute* Pour random sequences 
of the stimulus words were used to prevent a possible sequence effect. A 
particular sequence was assigned randomly to subjects at each test 
administration. 

The word association (WA) data were converted into a matrix of similarities 
between concepts by means of the r elatedness coefficient as described by 
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Shavelson (197'l). (See also (Garskof & Houston, 1963). 
Instrumentation 

In addition to the WA test, two other measui'es were used to provide 
further infontiation about the subjects: an attitude questionnaire and an 
achievement test on probability. Ihe attitude questionnaire was the "Pro-Math 
Conposite" scale (PYOll; see Wilson, Cahen, & Begle,1968) developed by the 
National Longitudinal Study of Mathematical Abilities (NLSMA) . The scale was 
designed to rreasure general attitude toward mathematics. Internal consistency 
coefficient alpha for this scale was O.76 for the subjects used in this study. 

The main achievement test consisted of twenty-eight free response and 
seven multiple choice items. The first thirty items tested comprehension 
of the material presented in the probability text. The last five items 
presented problems on probability in a perspective different from that used 
in the programmed text. Internal consistency coefficients alpha calculated 
from experlinental subjects' data in the present study were 0*780 and 
at posttest and retention test, respectively. 

In addition to the thirty-five item achievement test, two ten item tests 
were given to the experlj^ental subjects at the end of Sections 1 and 2 of the 
probability text, respectively. These tests were used only to give experimen- 
tal subjects a progress check and to help insure that subjects did not proceed 
so quickly through the prograrmed material that little or no learning took place* 
Treatment and Procedures 

Subjects were assigned randomly to experimental and control treatments.. 
Subjects in tlie experimental treatment read and studied the programmed text 
on probability theory. Subjects in the control group read and studied a 
progt^amned text on an unrelated mathematical topic, negative number bases. 
Experimental subjects (N 20) were never separated fix^m control subjects 
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(N = 14) during the experiment but subjects knew that two different program- 
med texts were being used. ■ ■ ...^ 

The study was conducted over 22 calendar days in the subjects' class- ' 
rooms during normal school hoiars near the end of. the 1971-1972 academic year 
With the exception of the retention test, the study was carried out during 
consecutive, 53 minute meetings of the classes which met every school day. 
The first class meeting was devoted to orientation and pretesting. The . 
orientation infonned the subjects t^iat they were participating in a study 
to find out how students learn mathematics. The attitude questionnaire, 
the WAtest, and the achievement test on probability were administered, 
5x\ the order listed, to all subjects prior to instruction. A brief discussion 
on using programmed instruction effectively followed the pretesting. Each 
subject then read the text assigned to him. At the end of each text section, 
each subject in both treatments received a short review test over the section 
he had just completed. . (The probability text did not have a test for Section 33 
the final section). Since instruction was self-paced not all Ss needed the 
entire instructional period to complete the text material; conversely, 
not all Ss read the entire text. However, all experimental subjects completed 
the second text section and most of the third section. Subjects who finished 
early were allowed to read, draw, or study material of their choosing as 
long as the material was non-mathematical. 

After instruction, all subjects were given the VIA test and achievement 
test, in the order listed. All subjects in a class were posttested at the same 
time and then 11 calendar days after.'/ards, the WA test and achievement test 
were readministered as retention tests to subjects in the sequence listed. 
The design of the study, then, was a 2 x 3 (treatment by test occasion) design with 
repeated measures on the latter factor. 

Results 

^ Cognitive Structure 

: Achievement test data . Achievement test scores were used as a methodological 
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check on students' learning of probability. If differences between treat- 
ment groups m traditional measures of learning mathemtics are observed, con-. 
fldence Is Increased in interpretations of differences observed in cognitive 
structure. Descriptive data from the achievement test are presented in O^ble 1, 
Ihese data were analyzed by a 2 x 3 (treatment by test occasion) analysis 
of variance vdth repeated measures on the second factor. Results obtained 
were: a) a significant treatment effect (F « 22.55, df 1/14, p < .01); 

b) a significant test occasion effect (P » 25.19,df = 2/13, P < .01); ard 

c) a significant interaction between effects (P = 24.59, df « 2/lS, p < .01). 

At pretest there was little difference between experlinental and control 
subjects, but large differences occur between groups at posttest and retention 
test. Tbe experimental group learned to solve significantly more problems in 
probability as a result of Instruction than did subjects In the control group. 

I^ble 1 

Means and Standard Deviations of Scores on the Achievement Ttest for each 

Treatment and Test Occasion. 
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Word assoolablon data. Ihe results of the multidimensional scaling 

(Kruskal, 196t<) of median RC matrices at posttest and at retention test are ^ ^^^^^-^^^ 

presented in Figures and 5j respectively. Pretest WA data and control group WA 

data, with the exception of control group retention test WA data presented In Flgui^ i 

6, consisted of mostly zero elements and thus scaling solutions could not be obtained. 
Ihese results are consistent with our assumptions that : a) high school 

students were unf&nilar with the concepts of probability and b) 

Instruction in probability would change cognitive structure concerning 

concepts in probability. These assurrptiori^^are supported by the analysis 

of achievement test scores • 

Comparison of Content Structure and Cognitive Structure 

One way to conpare content structure and cognitive structure is to visually ^r^^^^^^^^ : 
examine the correspondence, or lack of it, between the multidimensional scaling 
solutions for the digraph and RC matrices. For subjects in the experimental 
group, a strong similarity between the representations of content structure 
and cognitive s tincture was found. At posttest (Figure ii ) experimental 
subjects distinguished concepts on only one dimension. With the exception of 
PPK)BABILnY the concepts are ordered almost exactly the same as in the 
content structure representation • However, the subjects appeared not to 
learn the distinctions in relationships that require a second dimension. 
At retention test (Figure 5)> experimental subjects not only retained 
that portion of the structure they learned, but also reorganized the iiv 
cognitive structures In a manner more consistent with content structure* 
Again the subjects appeared not to n^e all the distinctions present in the 
content. For example, I^©EPE2^E^??^ WWALLY EXcmsiVEi; OOTC^ 



EMPERIMEM', and TRIAL are grouped too closely vdth no strong distinction 
between abstract versus concrete concepts noted In the content structure. 
These results are consistent with the results of a study of eighth grade 
students (Geeslln, 1973, 1974), although not as striking as the eighth 
grade results. 

It was possible to .obtain a scaling solution (Figure. 6) of 
control subjects' retention test WA data. However, the clusters of concepts 
we noted in the content structure (Figure 1) do not seem to be present In 
control subjects' cognitive structures. Thus, although control subjects' 
became familiar with the concepts through the testing procedure, they did not 
organize these concepts In an Interpretable manner. This Indicates that al- 
though the verbal environment (e.g. the testing, procedures ) may increase the 
RC coefficient, the presence of concepts in the verbal environment is not 
sufficient to provide the knowledge of structure provided by Instruction. That 

1 

Is, the instructional material provides something more than Just familiarity 
with concepts, it provides something concerning the relationships between these 
concepts. 

Figure 4 

CVie Dimensional Scaling Solution 
Experlinental SubjectG Posttest 
Median Relatedness Coefficient Ifetrlx 
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•IVo Divisional Scaling Solution 
ExperljTjental Subjects Retention otesfc 
Median Relatedness Coefficient Matrix 
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Figure 6 

Two Dimensional Scaling Solution 
Control Subjects Retention Test 
Median Relatedness Coefficient Matrix 
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A second met^jod of corrparing strictures is to calculate the Euclidean 
distance between the digraph slMlai^ity matrix and the RC matrix. Thds 
provided an Indication of the slMlai'ity between the two matrices. (The 
smaller the distance, the closer the match between the RC matrix and the 
digraph similarity matrix.^) For each subject, at each testing time, ths 
Euclidean distance between his RC matrix and the digraph matrix was calcu- 
lated ^ ilie correspondence between content structure and cognitive structure 
is shown in Figure 7 for the experimental and control groups. These data 
indicate that experimental subjects' cognitive structures corresponded much 
more closely to the content structure following instruction than prior, 
to instruction. Some change in control subjects' cognitive structures is 
noted also, but the magiitude and rate of decline were not of the magnitude 
and rate found in the experlinental group. The control group retention test 
data was obtained in the last week of school and the number of subjects drop- 
ped significantly (N=6). It appeared that only- the brighter contr(3»l subjects 
appeared for this test session and thus tte similarity to experimental 
data is probably spurious and was not consistent with other results (Geeslln 
1973. 197'i). 

A nonparametrlc analysis of variance (Bradley, 1968) was performed on 
the Euclidean distance data at pretest aiii posttest . TTie cognitive stt\icture 
of subjects in the experimental group corresponded more closely to content 
structure than did the cognitive structure of subjects in the control groi^j ^ 
(pi <01). 



The Euclidean distance Is obtained by squaring each dlffei^nc^ between 
cori^esponding elements of two matrices (e.g. a subject's RC matrix and the 
digraph similarity matrix), sumnlng the squares, taking the square root of 
this sum, and dividing by ninety (the number of off -diagonal elements In each 
matrix). 

^ ^ Sin<«'&:the smallest value of a RC is zero, sotre RC matrices consl6'S?2^f' 
only off-diagonal elements that are zero. Ohls may cause a EuolideM "distance 
to b6 smaller than it should be, since it Is possible to be further 'a\^y from 
the content structure. 
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Scores from the attitude, achievement, and cognitive structure measures 
were intercorrelated to explore possible relationships among the variables • 
These correlations , Kendall ' s Iku , are presented in Table 2 for the experljnent al 
group. The correspondence variable refers to the Euclidean distance between 
an Individual's RC matrix (cognitive structure) and the digraph similarity 
matrix (content structure). Perfect correspondence between achievement 
data and WA data would be indicated by a correlation of -1.0 since a 
smaller Euclidean distance score iirplies a closer relationship betw^^^ 
structure and cognitive structure. 



Figure 7 

. Median Euclidean Distances Between 
Content Structure and Cognitive Structure 
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Ohble 2 

Rank Order Correlations (Tau) Between All 
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The correlations Indicate that scoi'es on the attitude scale have a low 
correlation with scores on otl-ier variables. Scores on achievement at pretest 
have a low correlation with achievement posttest scores. Ihls is consistent 
with the findings that subjects knew little about probability before the 
study but learned about probability as a result of instruction. A high 
correlation between scores on achievement at posttest and retention test 
was obtained} this indicates subjects retained knowledge in accordance 
with their litmediate learning, l^e correlations between variables repre- 
senting the correspondence of cognitive structure with content structure 
showed a pattern similar to that of the achievement test scores. Low 
correlations between achievement and correspondence variables were obtained 
with the exception of the posttest data. Ihls may Indicate that learning 
to solve problems and learning of mathematical structure represent different 
aspects of learning. Although this finding is consistent with past studies 
(Shavelson, 1971, 1972), a stronger relationship was expected. Ihe posttest 
correlation between achievement and the correspondance variable was of 
moderate size and in the expected direction indicating some connection between 

learning of structure and achievement in this sairple. 

> 

.i': ... . . ...... ..... . - : ' "» 

Conclusions 

This study indicated that the analysis of content structure using digraph 
theory could be applied to a mathematics curriculum. Ihe results of the 
analysis — a map of content structure— agreed with our' understanding 
of the structure of the subject matter in probability. 

Ihe achievement test data indicated that the progranwed text on probability 
was effective in teaching probability to high school students. Compared to 
: ..... subjects |ri"^|-.cpntro;i ^^p^ subjects in the experimental group learned hov^ -. 
i • ;. to solve significantly more problems as a result of instruction and retained 

this learning at retention test. Furthermore, subjects in the experimental 
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group learned a significant portion of the structure of probability as ■ 
a result of instruction while the control group learned almost nothing of 
the structure. TVds learning of structure was retained until retention 
test time (a factor not investigated in prior studies ) . However , learning 
structure and learning to calculate solutions to problems in probability 
may develop independently of each other • 

The structure methodology used in this study appears to be applicable, 
to many aspects of research on learning mathematical structures and might 
be a helpful tool in formative evaluation of mathematics curricula . That 
is > the data on content structure and cognitive structure seem to suggest 
ways to luprove the text to further stx:ident learning of structure • 
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